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Abstract 

We show that a certain integral representation of the one-sided Skorokhod reflec- 
tion of a continuous bounded variation function characterizes the reflection in that it 
possesses a unique maximal solution which solves the Skorokhod reflection problem. 



1 Introduction 



The Skorokhod reflection problem has a long history. Skorokhod [10] introduced it as a 
method for representing a diffusion process with a reflecting boundary at zero. Given a 
continuous function X : [0, oo) — >• M, the standard Skorokhod reflection problem seeks to 
find {Q(t),t > 0) and a continuous, nondecreasing function Y : [0, oo) — )■ M+ with 1^(0) = 0, 
such that Q{t) := X{t) + Y{t) > for all t, and Q{s)dY{s) = 0. Intuitively, the latter 
expresses the idea that Y can increase only at points t such that X{t) + Y{t) = 0. Skorokhod 
[10| showed that there is only one such Y, namely, Y(t) = — info<<i<t(X(s) A 0) and thus 

Q{t) = X{t) V sup {X{t) - X{s)). 

0<s<t 

We use the standard notation a\/b := max(a, b), a/\h := min(a, b). The mapping X ^ Q \s 
referred to as the (one-sided) Skorokhod refiection mapping and has now become a standard 
tool in probability theory and other areas. As an example, we recall that if X is the path of a 
Brownian motion then Q is a reflecting Brownian motion and Q{t) has the same distribution 
as |^(t)| for all f > [31 [9]. Several extensions of the Skorokhod reflection mapping exist 
generalizing the range oi X (see, e.g., [11]) or its domain (see, e.g., [1]). 

The question resolved in this paper was motivated by an application of the Skorokhod 
reflection in stochastic fluid queues [HIS]. Suppose that A, C are two jointly stationary and 
ergodic random measures defined on a common probability space (0, P), with intensities 
a, c, respectively, such that a < c. Then there exists a unique stationary and ergodic 
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stochastic process {Q{t), t gM.) defined on (Q, P) such that, for all to ^ I^i (Q(^o + ^ — 
0) is the Skorokhod reflection of {Q{to) + A{to,to + t] — C{to, to + t], t > 0). In addition, if 
the random measures A, C have no atoms then 

Q{t)= f ±{Q{s)>C{s,t\)dA{s), (1) 

J — oo 

for all t G M, P-almost surely. The latter equation was called an "integral representation" 
of Skorokhod reflection and extensions of it were formulated and proved in [6] . The integral 
representation was found to be useful in several applications, e.g. (i) in deriving the so-called 
Little's law for stochastic fluid queues [2, stating that E[(5(0)] = (o/c)Eyi[(5(0)], where "Ka is 
expectation with respect to the Palm measure [4] of P with respect to A, and (ii) in deriving 
the form of the stationary distribution of a stochastic process derived from the local time 
of a Levy process [5]. 

In an open problems session of the workshop on "New Topics at the Interface Between 
Probability and Communications" [8], the second author asked whether and in what sense 
([1]) characterizes Skorokhod reflection. The question will be made precise in Section [2] below, 
where the main theorem. Theorem [H which answers the question, is stated. In Section [3] 
the integral representation is explicitly proved, along with some auxiliary results. Finally, 
in Section |4] a proof of Theorem [T] is given. 

2 The problem 

Consider a locally flnite signed measure X on the Borel sets of M. Assume that X has no 
atoms, i.e. X{{t}) = for ah t € M. Deflne 

Q*{t) := sup X{s,t], t > 0, (2) 

0<s<t 

where X{s,t] = X{(s,t]) is the value of X at the interval {s,t]. In particular, 

g*(o) = 0. 

Let X{t) := X{0,t] and write ^ as 

Q*{t) = Xit)- mi X{s). 

0<s<t 

The standard terminology [U [12] is that Q* solves the Skorokhod reflection problem for the 
function t X{t). 

Decompose X as the difference of two locally flnite nonnegative measures A, C, without 
atoms, i.e. write 

X = A-C. (3) 

We stress that A, C are not necessarily the positive and negative parts of X. In other 
words, the decomposition is not unique. For instance, we can add an arbitrary locally finite 
nonnegative measure without atoms to both A and C. 

^Since X,A,C are assumed to have no atoms, we may as well write X[s,f] or X{s,t) instead of X{s,t], 
and likewise for A and C, but we have chosen the notation to be consistent with possible generalizations. 
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In [6] it was proved that ([2]) also satisfies the fixed point equation referred to as "integral 
representation" of the reflected process: 

Q{t) = f l(Q(s) > C(s, t\) dA{s), t > 0. (4) 
Jo 

A simpler version of this appeared earlier in [7]; this version was concerned with the case 
where C is a multiple of the Lebesgue measure. In an open problems session of the workshop 
on "New Topics at the Interface Between Probability and Communications" [8], the second 
author asked whether and in what sense (jH) implies ([2]); the question was actually asked for 
the special case where C is a multiple of the Lebesgue measure. 

In this note we answer this question by proving the following: 

Theorem 1. Let A, C be locally finite Borel measures on = [0,oo) without atoms and 
consider the integral equation @. This integral equation admits a unique maximal solution, 
i.e. a solution which pointwise dominates any other solution. Further, this maximal solution 
is precisely the function Q* defined by ([2]). 

We proceed as follows. First, we present some auxiliary results and also give a proof of 
© =^ dH) which is different from the one found in [6] . Then we prove Theorem [1] by a 
successive approximation scheme and by proving a number of lemmas. 

3 Proof of the integral representation and auxiliary results 

We first exhibit some properties of Q*, defined by ([2]), and also show that Q* satisfies the 
integral equation ([4]) . The proof of the latter in the special case where C is a multiple of the 
Lebesgue measure can be found in [71 Lemma 1] and in [2l §3.5.3]. A more general case is 
dealt with in (H Theorem 1]. We give a different proof in Proposition [T] below. The lemmas 
below are straightforward and well-known but we give proofs for completeness. As before, 
X is a locally finite Borel measure without atoms and X = A — C is a decomposition as the 
difference of two nonnegative locally finite Borel measures without atoms. We set 

A{t) := A{0,t], C{t) ■.= C{0,t]. 

Lemma 1. If < s < s' < t and ifQ*{s) > C{s,t] then Q*{s') > C{s',t]. 

Proof. Assume that C{s,t] < Q*{s) = supQ^^^^ X{u, s]. This is equivalent to 
C{t) - C{s) < sup {A{s) - A{u) - {C{s) - C{u))} 

0<u<s 

= A{s) + sup {-A{u) + C{u)} - C{s), 

0<u<s 

that is, C{t) < A{s) + sup {-A{u) + C(n)}. 

0<u<s 

The right-hand side of the latter is increasing in s and so replacing s by a larger s' we obtain 

C{t) < A{s') + sup {-A{u) + cu}, 

0<u<s' 

which is equivalent to Q*{s') > C{s',t]. □ 
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Lemma 2. Q* satisfies 

Q*{t)= svcp X{u,t\\J {Q*{s) + X{s,t]), 0<s<t. (5) 

s<u<t 

Proof. We show that the right-hand side of ([5]) equals the left-hand side. 

sup X{u,t]V {Q*{s) + X{s,t]) = sup X{u,t\V{{ sup X{u, s]) + X{s,t]} 

s<u<t s<u<t 0<u<s 

= sup X{u,t]\/ sup {X{u,s]+ X{s,t]} 

s<u<t 0<u<s 

= sup X{u,t]\/ sup X{u,t] 

s<u<t 0<u<s 

= sup X{u,t] = Q*(t). 

0<u<t 

Lemma 3. If < s < t and ifQ*{s) > C{s,t] then Q*{t) = Q*{s) +X{s,t]. 

Proof. We use equation ([5]), rewritten as follows: 

Q*{t)= sup {Xiu,t]y {Q*{s)+X{s,t])}. (6) 

s<w<i 

Suppose < s <u <t and that Q*{s) > C{s,t]. Then Q*{s) > C{s,u] and so 

Q*{s) + Xis,t] > C{s,u] + X{s,t] 

= C{s,u] +A{s,t] - C{s,t] 

= A{s,t] - C(n,t] 

> A{u,t] - C{u,t] = X{u,t], 

and this inequality implies that the term X{u,t] inside the bracket of the right-hand side of 
([6]) is not needed. Hence Q*{t) = Q*{s) + X{s,t], which is what we wanted to prove. □ 

Define next 

a*{t) := sup{0 <s<t: Q*{s) < C{s,t]}. 

By Lemma [U 

Q*{s) <C{s,t], if < s < (7a) 
Q*{s) > C{s,t], iia*{t)<s<t, (7b) 

provided that the last inequality is non-vacuous. Since the function Q* is nonnegative and 
continuous, we also have 

Q*{a*{t)) = C{a*{t),t]. 

Proposition 1. If X is a locally finite signed Borel measure on [0, cxj) without atoms and 
if X = A — C is any decomposition of X as the difference of two nonnegative locally finite 
Borel measures without atoms, then the function Q* defined by ^ satisfies ^ . 
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Proof. By Lemma El and the last display, 

Q*[t) = Q*{a*{t)) + A{a*{t),t] - C{a*{t),t] 
= A{a*{t),t] 

dA[s) 

a'{t) 
t 



which is the integral representation formula Note that, to obtain the last equality in 
the last display, we used (f7al) - (j7b[) . □ 



4 Proof of Theorem [T] 



A priori^ it is not clear that (jH) admits a maximal solution and, even if it does, whether it 
satisfies ([2]). We shall show the validity of these claims in the sequel. 

We fix two locally finite measures A and C and define the map on the set of nonnegative 
measurable functions by 

S{Q){t) := fl{Q{s) > C{s,t]) dA{s), t > 0. (8) 

The integral equation then reads 

Q = e{Q). 

We observe that G is increasing: 

If Q < Q then G(Q) < e(Q). (9) 

Here, and in the sequel, given two functions f,g : [0,oo) — )■ M, we write f < g to mean 
that f{t) < g{t) for all t > 0. To see that dH) holds, simply observe that Q < Q implies 
l(Q(s) > C{s,t]) < l(Q(s) > C{s,t]) for all < s < i. 

Define next a sequence of functions (Qk, k = 0,1,2, .. .) by first letting 

Qo ■= oo, 

and then, recursively, 

Qk+i ■■= e{Qk), k>0. 
Clearly, Qi(t) = Jq* (iA(s) = A{t). So Qo ^ Qi- Since Q is an increasing map, we see that, 

Qk > Qk+i > 0, A; > 0. 

We can then define 

Qoo{t) ■■= lim Qkit). 

k—^OD 
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Lemma 4. If Q = Q{Q) then Q < Qoo- Furthermore, 

Q — QcyD • 

Proof. Suppose that Q satisfies Q = Q{Q)- Since the integrand in the right-hand side of 
dl]) is < 1, we have Q{t) < A{t) for all t > 0. Letting e^") be the /s-fold composition of 9 
with itself, we have 

Q = e'^''\Q)<Q'^'\A) = Qk, 
and so Q < Qoo- In particular, Proposition [1] states that Q* = Q{Q*). Hence Q* < Qoo- Q 

However, it is not yet clear at this point that Qoo is a fixed point of Q. We can only show 
that 

Qoo > e(Qoo). 

Indeed, Qoo < Qk for all k, and so l(Qoo(s) > C{s,t]) < l(Qfc(s) > C{s,t]), for aU < s < 
t, implying that 0(Qoo) < ©(Qfc) = Qk+i, and, by taking limits, that 9 (Qoo) < Qoo- 

Definition 1 (Regulating functions). Consider functions B : [0, cxj) [0,oo) which are 
continuous, nondecreasing, with -B(O) = 0, such that X{0,t] + B{t) > for all t > 0. Call 
these functions regulating functions of X . The set of regulating functions is denoted by 

n{x). 

We define a mapping 

<^ -.niX) ^Tl{X) (10) 
in two steps: Given B € 7^(X), first define 

asit) := sup{0 <s<t: A{s) + B{s) - C{t) < 0}, t> 0. 

Then let 

^B){t) := B{aB{t)), t > 0. 
We actually need to show that what is claimed in (jlOh holds. Namely: 
Lemma 5. If B e n{X) then ^{B) G 7^(X). 

Proof. Clearly, cysi') is nondecreasing. Since B is nondecreasing, it follows that ^{B) = 
Boas is nondecreasing. Also, <&(i?)(0) = -B(cjb(0)) = B{0) = 0. From the continuity of A, 
B and the definition of cjb, we have 

A{aB{t)) + Biasit)) = C(t), t > 0. (11) 

We also have, 

A{t) + $(5)(t) - C{t) = A{t) + B{aB{t)) - C{t) 

= [A{t) - AiaBm + [AiaBit)) + B{aB{t)) - C{t)] 
= A{t)- A{aB{t))>Q, 
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where we used (jlll) in the third step. It remains to show that is continuous. Note 

that o-b(-) need not be continuous. However, C(-) is a continuous function and so, by ([IT]) . 
t 1-^ A^asit)) + B{(TB{t)) is continuous. Hence 

[A{aB{t+)) - A{aB{t-)\ + [B{aB{t+)) - B{(jB{t-))] = 0, for ah t. 

Since A((Tb(-)) and B{aB{-)) are both nondecreasing, \i ioWows thai A{aB{t+))—A{aB{t—) > 
and B{aB{t+)) — B{aB{t—)) > and, since their sum is zero, they are both zero, implying 
that A((Tb(-)) and S((Tb(-)) are continuous. □ 

An immediate property of ^ is that 

< B for all B G n{X). (12) 

Indeed, for all t > 0, aBit) < t and so B{(jB{t)) < B{t). 

Starting with the function 

Bi{t):=C{t), t>0, (13) 

we recursively define 

:= $(Sfc), A; > 1. (14) 

Therefore 

Bi> B2> ■■■ > Bki Boo, as fc ^ OO, (15) 
where the inequalities and the limit are pointwise. 



Lemma 6. The function Boo, defined via (|13p . (I14p and (jlSp . is a member of the class 

n{x). 

Proof. Boo is nondecreasing since all the B^ are nondecreasing. Also, Boo{0) = 0. Since 
for all k, A + Bj. — C > 0, we have A + Boo — C > 0. We proceed to show that Boo is a 
continuous function. We observe that, for < t < t', 

|$(i?)(0 - ^{B){t)\ = \B{aB{t')) - B{aBm 
= B{aB{t'))-B{aB{t)) 

< A{aB{t')) - A{aB{t)) + B{aB{t')) - B{aB{t)) 
= [A{aB{t')) + B{aBit'))] - [AiMt)) + BiaBit))] 
= C{t') - C{t), 

where we again used (jll|) . It follows that the family of functions {^{B),B € TZ{X)} is 
uniformly bounded and equicontinuous on each compact interval of the real line. By the 
Arzela-Ascoli theorem, the family is compact and therefore Boo is continuous. We have 
estabhshed that Boo e 7^(X). □ 

We now claim that -Boo is a fixed point of 
Lemma 7. <I>(-Boo) = -Boo- 
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Proof. By definition, 
where 

(^Bo^it) = sup{0 <s<t: A{s)+B^{s) < C{t)}. 
Now, since > Bk+i for all A; > 1, it follows that as^ ^ ^B^+i foi^ k > 1, and so 

cJL(t) := lim cJB,(t) 

is well-defined. Since iJ^ > -Boo for all A; > 1, we have cr^^ < ^Baa- Taking limits, we find 

Using the last two displays and the fact that Bk and B^o are nondecreasing, we have 

$(Soo)(t) = B^{aB^{t)) > B^{aL{t)) 

= lim Bk{(JL{t)) 

k—^oo 

> lim Bk{(JB,{t)) 

k^oo 

= lim Bk+i{t) = B^{t). 

k—KX) 

By inequality ([H]), <^{B) < B for all B G 7^(X) and since, by Lemma El B^o G 'T^l^), it 
follows that we also have i?oo < '^'(-Boo)- Therefore -Boo = ^{Boo), as claimed. □ 

Lemma 8. Consider the function Q* defined by ([2]) and define a function U by 

U{t):=Q*{t)-X{0,t], t>0. 

Then 

(i) u e n{x). 

(ii) u = $([/). 

Proof, (i) We have X(0, t] + U{t) = Q*{t) > for ah t. Using ^ and 1^ we see that 

U{t) = sup {-A{s) + (7(s)}. (16) 

0<s<t 

Therefore, U (0) = 0, and [/ is a continuous and nondecreasing. We conclude that U G TZ{X). 
To prove (ii), recall that <!>([/) = Uoajj where 

au{t) = sup{0 < s < t : A{s) + C/(s) < C(t)}. 

Splitting the supremum in (I16p in two parts, we obtain 

U{t)= sup {-A(s) + C7(s)} V sup {-A(s) + C(s)}. 

0<s<<Ju{t) o-[/(t)<s<i 

= [/(cjt7(t)) V sup {-^(s) + C(s)}. 

au{t)<s<t 

For s > (Jc/(t), we have A{s) + ?7(s) > C{t), i.e. -A(s) + C{s) < U{s) - C{s,t]. Therefore 

U{t) < U{au{t)) V sup {U{s) - C{s, t]} 

(7u{t)<S<t 

= u{au{t) = mm. 

Thus, U < ^{U). On the other hand, since U G 7l(X), we have $([/) < U, by □ 
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Lemma 9. Let B € TtiX) he any fixed point of ^. Then B <U. 
Proof. Since B = ^{B) = Boas we have 



B = SoaJ^ 



where cTr'' := 03° ■ ■ ■ °o'b- Since 



k times 



we may define 

By the continuity of B, 



t > aeit) > OBoaBit) > ■ ■ ■> a'^^\t), 



a'^\t) := lim a'^\t). 



B = Boa^^\ (17) 



'B 

On the other hand, gives 

yloa(J+^)+i?o4^+i)=Coa(J), k>l. 
Taking the hmit as A; — ?• 00, and using the continuity of ^, B and C, we have 

AocTg + Boa^ = Cocj^ 
Since A{t) + U{t) > C{t) for ah t, we have 

A (00) , (00) ^ ^ (00) 

^0(T^ ^ + U 0(T^ ' > G o(7^ ^ , 

and from the last two displays we conclude that 

j-r (00) ^ (00) 

Uoa^ > Boag . 

Since U is nondecreasing and since (|17p holds, we have 

U > Uoaf^ > Boa^^^ = B, 

as claimed. □ 

We are now ready to prove Theorem [TJ We already know from Lemma H] that Q* < Q°° . 
So we only have to prove the opposite inequality. Recall that Qi = A and Bi = C. Trivially 
then 

Qi{t) + C{t) = A{t) + Bi{t), t>0. 
Thus, for < s < t we have 



Qi{s) > Cis,t] ^ Qi{s) + C(s) > Cit) 
^ A{s) + Bi{s) > C{t) 
s > asiit). 
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From this we get 

Q2{t)= [\{Qi{s) > C{s,t]) dAis) 
Jo 

= [ l{s> aeAt)) dA{s) 
Jo 

= A{t)-A{aBAt)). 



But gives 
and so 



A{aBAt)) + Bi{aBAt))=C{t), 



Q2{t) + C{t) = Ait) + BiiaBAt)) = A{t) + ^2(t), t > 0. 
We now claim that 

Qk{t)+C{t) = A{t) + Bk{t), t>0, k>l. 

This can be proved by induction along the same lines as above. Taking limits as k ^ oo, 
we conclude 

Qoc{t) + C{t) = A{t) + B^{t), t>0. 
Lemma [7] tells us that B^q is a fixed point of and so, by Lemma O 

5oo < U. 

Hence 

Qoo{t) + C{t) = A{t) + Boo{t) 
< A{t) + U{t) 
= Q*{t) + Cit), t>0, 

and this gives 

Qoo ^ Q ) 

as needed. □ 
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